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Abstract 

We extend Noether’s theorem to dynamical optimal control systems 
being under the action of nonconservative forces. A systematic way 
of calculating conservation laws for nonconservative optimal control 
problems is given. As a corollary, the conserved quantities previously 
obtained in the literature for nonconservative problems of mechanics 
and the calculus of variations are derived. 
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1 Introduction 

The concept of symmetry plays an important role both in Physics and 
Mathematics. Symmetries are described by transformations of the system, 
which result in the same object after the transformation is carried out. 
They are described mathematically by parameter groups of transformations. 
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Their importance ranges from fundamental and theoretical aspects to con¬ 
crete applications, having profound implications in the dynamical behavior 
of the systems, and in their basic qualitative properties. 

Another fundamental notion in Physics and Mathematics is the one of 
conservation law. Typical application of conservation laws in the calculus 
of variations and optimal control is to reduce the number of degrees of 
freedom, and thus reducing the problems to a lower dimension, facilitating 
the integration of the differential equations given by the necessary optimality 
conditions. 

Emmy Noether was the first who proved, in 1918, that the notions of 
symmetry and conservation law are connected: when a system exhibits a 
symmetry, then a conservation law can be obtained. One of the most im¬ 
portant and well known illustrations of this deep and rich relation, is given 
by the conservation of energy in Mechanics: the autonomous Lagrangian 
L(q,q), correspondent to a mechanical system of conservative points, is in¬ 
variant under time-translations (time-homogeneity symmetry), and 

dL 

~L ( q(t ), q(t)) + t jt ( q(t ), q(t)) ■ q(t) = constant (1) 

follows from Noether’s theorem, i.e., the total energy of a conservative closed 
system always remain constant in time, “it cannot be created or destroyed, 
but only transferred from one form into another”. Expression m is valid 
along all the Euler-Lagrange extremals q(-) of an autonomous problem of 
the calculus of variations. The conservation law m is known in the calculus 
of variations as the 2nd Erdmann necessary condition; in concrete applica¬ 
tions, it gains different interpretations: conservation of energy in Mechanics; 
income-wealth law in Economics; first law of Thermodynamics; etc. The lit¬ 
erature on Noether’s theorem is vast, and many extensions of the classical 
results of Emmy Noether are now available for the more general setting 
of optimal control (see e.g. n u na nn, and references therein). Here 
we remark that in all those results conservation laws always refer to closed 
systems. 

It turns out that in practical terms closed systems do not exist: forces 
that do not store energy, so-called nonconservative or dissipative forces, are 
always present in real systems. Friction is a nonconservative force, but others 
do exist. Any friction-type force, like air resistance, is a nonconservative 
force. Nonconservative forces remove energy from the systems and, as a 
consequence, the conservation law 0 is broken. This explains, for instance, 
why the innumerable “perpetual motion machines” that have been proposed 
fail. In presence of external nonconservative forces, Noether’s theorem and 
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respective conservation laws cease to be valid. However, it is still possible 
to obtain a Noether-type theorem which covers both conservative (closed 
system) and nonconservative cases [3, 0J . Roughly speaking, one can prove 
that Noether’s conservation laws are still valid if a new term, involving the 
nonconservative forces, is added to the standard conservation laws. 

Here we extend previous nonconservative results Eia to the wider con¬ 
text of optimal control. For that, and differently from 011, where the 
Lagrangian formalism is considered, we adopt an Hamiltonian point of view. 

2 Preliminaries 

Let us consider the optimal control problem in Lagrange form: 

-%(■)>“(•)]=/' L(t,q(t),u(t))dt —* min, (P) 

J a 

q(t) =ip(t,q(t),u(t)) , 

together with some boundary conditions on g(-). In problem 
and the Lagrangian L : [a, 6] X M” x R m —> K and the velocity vector 
ip : [a, b] x M n x — y 1™ are assumed to be C 1 functions with respect to 
all the arguments. In agreement with the calculus of variations, we assume 
the admissible state trajectories to be piecewise smooth, and the admissi¬ 
ble control functions to be piecewise constant with no restrictions on their 
values: q(-) € PC 1 ([a, 6]; R n ), «(•) € PC([a, b]\ M m ). 

Remark 1 There is no classical Hamiltonian theory for constrained varia¬ 
tional problems. For an ongoing attempt to develop it, we refer the reader 
to Ch. 6]. 

Remark 2 The fundamental problem of the calculus of variations, 

I[q(-)\ = f L(t,q(t),q(t)) —> min , (2) 

J a 

is a particular case of problem 0 : in that case (pit , q, u ) = u. The problems 
of the calculus of variations with higher-order derivatives are also easily 
written in the optimal control form 0 - For example, the problem of the 
calculus of variations with derivatives of second order, 

I[q(-)\ = [ L(t,q(t),q(t),q(t)) —*min, (3) 
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is equivalent to problem 



L(t,g ll (t),g 1 (t),u(t)) 


min, 


q°(t)=q 1 (t), 
q 1 ^) = u(t ) . 


In the fifties of the twentieth century, L.S. Pontryagin and his collabo¬ 
rators proved the main necessary optimality condition for optimal control 
problems: the famous Pontryagin Maximum Principle 0. 


Definition 3 (Process) An admissible pair (q(-),u(-)) satisfying the con¬ 
trol system q{t) = ip (t,q(t),u(t)) of t £ [a, b], is called a process. 

Theorem 4 (Pontryagin Maximum Principle— |9j) If (q(-), u(-)) is an 
optimal process for problem then there exists a vectorial function p(-) £ 
PC^Qa, 6];R n ) such that the following conditions hold: 

• the Hamiltonian system 

U{t) = T$(t,q(t),u(t),p(t)), 

\p(t) = ~%f(t,q(t),u(t),p(t)); 

• the stationary condition 

^(t,q(t),u(t),p(t)) = 0; (5) 

with the Hamiltonian H defined by 

H(t,,q,u,p) = -L (t, q, u) + p ■ <p (t, q, u) . (6) 


Remark 5 In mechanics, p corresponds to the generalized momentum. In 
the language of optimal control p is called the adjoint variable. 


Definition 6 Any triplet (g(-), u(-),p(-)) satisfying the conditions of Theo¬ 
rem^ is called a Pontryagin extremal. 

Remark 7 The Pontryagin Maximum Principle is more general than we 
state it here. Written as in Theoremthe Pontryagin Maximum Principle 
is also known as Hestenes Theorem. In particular, we are only considering 
normal Pontryagin extremals. 
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From the Hamiltonian system © and the stationary condition ©, it follows 
that 

^{t,q{t),u(t),p{t)) = . (7) 

When the optimal control problem m is autonomous (when the Hamil¬ 
tonian © does not depend explicitly on time t ) one obtains from © the 
conservation law 

7 i(t, q(t),u(t),p(t)) = const. (8) 

For the fundamental problem of the calculus of variations © (ip = u => 
H = — L + p ■ u) one obtains from the Pontryagin Maximum Principle: 


dH 

du 


dH 

Up ~ u ’ 
dH _ dL 
dq dq 


dL 

0 O- p = —— => p = 
du 


d dL 
dt du ' 


Comparing the two expressions for p, one arrives to the Euler-Lagrange 
differential equations: 

d dL dL 
dt du dq ' 

When the fundamental problem of the calculus of variations is autonomous, 
equality © reduces to ©. 

In the presence of nonconservative forces Q(t, q(t), q(t)), i.e. forces which 
are not equivalent to the gradient of a potential, like friction and drag, the 
Euler-Lagrange equations © are no longer valid, and it is well-known that 
they must be substituted by 


d dL _ dL 
dt du dq ~*~ 


( 10 ) 


(see e.g. jl]). In Physics the Hamiltonian formalism is not common for the 
nonconservative case. However, it is clear that Theorem 0] and property 0 
must be also changed when considering the influence of external dissipative 
forces Q. This will be addressed in © 

Following [2|, the notion of invariance for problem m is defined in terms 
of the Hamiltonian, by introducing the augmented functional 


J[q{-),u(-),p(-)} = / [H(t,q(t),u(t),p(t))-p(t)-q(t)]dt, 

J a 

where H is given by ©• 
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Definition 8 (Invariance up to a gauge term cf. J2j) An optimal con¬ 
trol problem © is said to be invariant under the £-parameter local group of 
transformations 

t(t) = t + £T(t,q(t),u(t),p(t)) + o(e), 

<i{t) =q(t) + ££(t,q(t),u(t),p(t)) +o(e), ^ 

u(t) = u(t ) + sa(t, q(t),u(t),p(t )) + o(e), 
p(t) = p(t) + ea(t, q(t),u(t),p(t)) + o(e), 

if, and only if, there exists a function A such that 

[H(t,q,u,p) - p-q]dt= [H(t,q,u,p) -p - q]dt + edA(t,q,u,p) . (12) 

Remark 9 Function A of Definition 0 is called a gauge term in the Physics 
literature. In the particular case A = 0, one obtains the concept of absolute 
invariance. 


Remark 10 We can write equation m in the following way: 

[H(t,q,u,p) - p-q = [H(t,q,u,p) - p ■ q\ + (13) 

Functions r, £, a, and a are known as the infinitesimal generators of the 
invariance-transformations m ■ Next theorem asserts that generators are 
sufficient to define invariance. 


Theorem 11 (Necessary and sufficient condition of invariance) Problem 
© is said to be invariant up to the gauge term A if, and only if ., 


dn . on on ,dn d\ 

T iH +( -^ +a -ik: +a -^- ,l) - (r+TH = ^ (14) 


Proof. Having in mind that for e = 0 one has t = t, q = q, u = u, p = p, 
we differentiate m with respect to e and then put e = 0. ■ 


Definition 12 A quadruple (r,£,cr,a) is said to be a symmetry of the op¬ 
timal control problem © if it satisfies condition d for a certain A. We 
talk about exact symmetries if A = 0. 

Remark 13 It is possible to use a modern computer algebra system to com¬ 
pute the symmetries of an optimal control problem © in an automatic way 
-see Jfjjj/. 
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Remark 14 For the fundamental problem of the calculus of variations 
the necessary and sufficient condition of invariance m takes the well- 
known form (cf. e.g. 0 PP- 4^9]) 


BL BL BL f ■ \ dA 


Remark 15 For the problem of the calculus of variations with derivatives 
of second order ©, the necessary and sufficient condition of invariance mi 
takes the form (cf. 11A Lemma 5.5]) 


Bt 


Bq 


BL i 

/ BL 

d BL\ r 

; \ BL / ■ 

■ -\ 

+ 

1 

v Bq 

dt Bq ) V 

*~ T V + wk 

l -rqj 


dA 

dt 


3 Main Result 


We begin by introducing the notion of nonconservative Hamiltonian sys¬ 
tem. Such concept must lead us to equations EB in the particular case 
of the fundamental problem of the calculus of variations under presence of 
nonconservative forces Q. 

Definition 16 (Nonconservative Hamiltonian System) We define the 
nonconservative Hamiltonian system by 

U(t) = ^(t,q(t),u(t),p(t)), 

\p(t) = ~^(t,q(t),u(t),p(t))+ Q(t,q(t),u(t )), 

where hi is given as in ©. 


Remark 17 For the particular case of the fundamental problem of the cal¬ 
culus of variations (ip = u), the nonconservative Hamiltonian system (115f) . 
together with the stationary condition lead us to the nonconservative 
Euler-Lagrange equations m: 


p 


q = = u, 

Bp 

BH ^ BL ^ 
— —~k -b Q ~ VT -b Q , 

Bq Bq 


d BL 
dt Bu ’ 

and comparing the two expressions for p we obtain equation CO- 


Bhi BL u un 

= 0<^p= — ^p = — — 

Bu dt ou 


Bu 
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Similarly to Definitional we introduce now the notion of nonconservative 
extremal. 

Definition 18 (Nonconservative Extremal) Any triplet (q{-), u(-),p(-)), 
satisfying the stationary condition © and the nonconservative Hamiltonian 
system m, will be called a nonconservative extremal. 

Proposition 19 The following property holds along the nonconservative ex¬ 
tremals: 

^r( t,q{t),u{t),p(t )) 

(YH 

= <?(£)> + Q(t, q(t),u{t )) • — (t, q(t),u(t),p(t )). (16) 

Proof. Equality (1161) is a simple consequence of the the stationary condition 
© and the nonconservative Hamiltonian system ©• ■ 

Remark 20 In the particular case Q = 0 (conservative case), the non¬ 
conservative Hamiltonian system (ESI takes the form ©, and the set of 
nonconservative extremals coincide with the set of Pontryagin extremals. In 
that situation, property (fTCl) equals 0. 

Definition 21 (Nonconservative Constants of Motion) We say that 
a function C(t,q,u,p ) is a nonconservative constant of motion if it is pre¬ 
served along any nonconservative extremal (q(-),u(-),p(-)): 

C(t,q(t),u(t),p(t)) = c, c constant , V t E [a, b]. (17) 

Equation m is then said to be a nonconservative conservation law. 

Generalizations of the classical Noether’s theorem of the calculus of varia¬ 
tions include: (i) (conservative) Noether-type theorems for the more general 
framework of optimal control, asserting the existence of a preserved quan¬ 
tity along the Pontryagin extremals, whenever a symmetry occurs - see 
[smrmuTT]: (ii) Noether-type theorems for the nonconservative calculus 
of variations, asserting that existence of a symmetry implies the existence 
of a preserved quantity along the solutions of the nonconservative Euler- 
Lagrange equations © - see ©m. Next theorem extends the mentioned 
Noether-type results: to each symmetry of the optimal control problem m 
there exists a nonconservative conservation law in the sense of Definition al! 
Essentially, for <5 = 0 one gets from Theorem [22] the results obtained in 
©©©©; restricting ourselves to the problems of the calculus of varia¬ 
tions, one gets the results found in ©© 
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Theorem 22 (Nonconservative Noether’s Theorem) If (r, £, <r, a) is 

a symmetry of the optimal control problem and there exists a function 
f = f(t,q,u) such that 

fjf = Q ■ (f - T i ), ( 18 ) 

where Q denotes the external nonconservative forces acting on the system, 
then 

C(t,q,u,p ) = H(t,q,u,p)T -p- £ + f(t,q,u) - A(t,q,u,p) (19) 
is a nonconservative constant of motion. 


Remark 23 Similarly to Hueam, only the generators r and f, cor¬ 
responding to the transformations of the time and state variables, appear in 
Noether’s conservation laws (cf. expression (|T9l ) ). 

Proof. Substituting (cf. Proposition HTH) 

dH ■ cG .. _ 8U . . 

T w +TH ~ p ' i = dt {nT ~ p ' Q ~ TQ 'w +p ' ( 

into d, and using conditions ©> d, and m, we obtain successively: 


d 


dH fdH 


0 = dt {nT - p ' i - A) - TQ '^ + 


dq 




0 = ~ p ■ f ~ N) + f ■ (-p + Q + p) - rq ■ Q , 

0 = - p ■ £ - A) + Q ■ (£ - rq) = ^(Wr - p ■ £ + / - A) 


Remark 24 Proof of Theorem \2d\ is very simple. This shows, in the opin¬ 
ion of the authors, that the Hamiltonian formalism provides the natural 
language to Noether’s theory. It is strange, from the mathematical point of 
view, why the Hamiltonian approach is not used in Physics with respect to 
nonconservative systems. 

As corollaries, we obtain the previous results known in the literature. 
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Corollary 25 (Optimal Control version of Noether’s Theorem - 
cf. e.g. m W) In the absence of nonconservative forces (i.e. in the 
conservative case Q = 0), if the optimal control problem © is invariant 
under the one-parameter transformations m, then function 


C(t, q, u,p ) = TLt — p ■ £ — A 


( 20 ) 


is preserved along any Pontryagin extremal. 

Proof. When Q = 0, (1181) implies that / is a constant, and the conservation 
law associated with the constant of motion m is equivalent to the one 
associated with (HU). ■ 

Corollary 26 (Nonconservative Noether’s theorem of the calculus 
of variations - cf. m For the fundamental problem of the calculus of 
variations © the constant of motion m is equivalent to 



( 21 ) 


that is, under the invariance hypotheses of Theorem A2°A expression m is 
preserved along all the solutions q(-) of the nonconservative Euler-Lagrange 
equations m- 

Proof. For the fundamental problem of the calculus of variations, ip = u 
and p = Qjjr, so that the Hamiltonian takes the form TL = — L + ^ ■ q. 
Substituting this expression in m, we obtain the desired conclusion. ■ 


Corollary 27 (Nonconservative Noether’s theorem for problems of 
the calculus of variations with second-order derivatives - cf. m) 

For the higher-order problem of the calculus of variations ©• the constant 
of motion (HU) is equivalent to 



( 22 ) 


Proof. For the problem of the calculus of variations with second-order 
derivatives, one has 7i (t, q°, q 1 , u^p 0 ^ 1 ) = —L{t,q®,q l ,u) + p°q 1 + p 1 u, 
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q°(t) = q(t), q 1 (t) = q(t), u(t) = q(t). Using these equalities, it follows from 
the Pontryagin Maximum Principle that 

dTL , dL 

— = 0 Op = 
du dq 


P° = 


dU 


dn _ dL 

"d^~~d^' 


dL d dL 

v = = 94 “ dtW 

In this case, the constant of motion takes the form 
C = Ht - p° ■ ^0 - p 1 ■ + / - A, 

and substituting H, p° and p 1 by its expressions, the intended result is 
obtained. ■ 


4 Examples 

We now illustrate the application of our result to some concrete problems 
of nonconservative classical mechanics. In all the examples, one can use the 
computational tools |6; to determine the symmetries. 

Example 28 (Forced Oscillations - cf. 3 pp. 114~H5]). Let us consider 
the problem of vertical oscillations of a body of mass m, connected to a 
spring of ignorable mass with constant of elasticity k, under the action of a 
sinusoidal nonconservative force Q(t ) = Fe lut , where F and u are positive 
constants. In this situation, the associated variational problem is given by 
(cf. H pp. 114-115]) 




1 


/ (mu 2 — kq 2 )dt 

Jo 

q(t) = u(t ). 


mm, 


The problem exhibits the following exact symmetries: (r, £, a, a) = (c, 0,0,0), 
where c is an arbitrary constant. From Theorem 1 2I\ we conclude that 


1 


— - ( mu(t ) 2 — kq(t) 2 )+p(t)u(t)~ / q(t)Fe lwt dt = const, t £ [0,T] , (23) 
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is a nonconservative conservation law. Corollary I #61 permits to write the 
conclusion (ESI in the notation of the calculus of variations: 

C(t, q, q) = i(- mq 2 + kq 2 ) - J Fqe lu)t dt 

is a nonconservative constant of motion (nonconservative extremals are de¬ 
fined by u(t ) = q(t), p(t ) = Fe lwt — kq(t), p(t) = mu(t)). In this simple 
example, such fact is easily verified by direct application of Definition 071 ' 
= 0 <=> q (mq + kq — Fe lujt ) = 0, which is a truism along the non¬ 
conservative Euler-Lagrange extremals - the solutions of the equation era 
mq + kq — Fe lut = 0. 


Example 29 (fH) We apply our results to the example studied in BP-’ « 
dynamical system with Lagrangian L(t,q,q) = q 2 /2, subjected to the non¬ 
conservative force Q = q 2 . The associated variational problem is given by 


J[?(0» «(■)] = u2dt 

q{t) =u, 


mm. 


and from Theorem \11\ we get the exact symmetries 


(r, £, a, a) = (2ci t + c 2 , c\q + c 3 , -ciu, -cip) , 

where Ci, i = 1,2,3, are constants. From Theorem, l##l we obtain the non¬ 
conservative conservation law 


(ciq(t) + c 3 )p(t) + Qu(t) 2 - p(t)u(t)^j (2cit + c 2 ) 

+ J {(2c\t + C 2 )q(t) — c\q(t) — c 3 )u(t) 2 dt = const. ( 24 ) 

The equation of motion is defined by u(t ) = q(t), p(t) = u{t) 2 , p(t) = u(t) 
(which is equivalent to the nonconservative Euler-Lagrange equation (1TU1) : 
q(t) = q 2 ), and we obtain the nonconservative conservation law (ED) in 
terms of the calculus of variations CD- 

Cl [?(*)g(t) - ^g(i) 2 ] - ^ c 2 g(t) 2 + C3?(i) 

+ / [2citg(t) — cig(t) + c 2 <?(i) — c 3 ] q(t) 2 dt = const. 
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Similarly to Example also here it is possible to verify the validity of 
m by definition: the nonconservative extremals (q(-),u(-),p(-)) are given 
by q(t ) = k] — ln(i — /C 2 ), u{t) = p(t ) = where k\ and k 2 are 

constants to be determined from the boundary conditions, and substituting 
the extremals in m, we obtain the tautology 0 = const. 

To finish the illustration of our methods, we consider a generalized me¬ 
chanical system with one degree of freedom, whose Lagrangian and noncon¬ 
servative force depends on higher-order derivatives. 

Example 30 (|3J) The following problem is borrowed from 0 %4]: 

L = \ (<? 2 + Q q 2 + b q 2 ) > 

Q = pq + (0 q~ 2 Q , 

where a, b, and p are constants. Replacing expression of L and Q into El, 
we conclude that Noether’s nonconservative constants of motion have the 
form 

C(t, q, q, q, Q ) = \t (q 2 + aq 2 + bq 2 ) + (aq - q)(f 0 - qr) 

+ <?(£ 1 - Qt) ~ f + A, (25) 

q^j dt. From the necessary and suf¬ 
ficient condition of invariance m, one obtains that the exact symmetries 
(A = Oj for the problem are given by (r, £ 1 , £ 2 , «i, 0 : 2 ) = (c, 0, 0,0, 0,0), 

where c is an arbitrary constant, and from El we conclude that 

7} (q 2 + a( i 2 + bq 2 ) - (M - 9)9 -q 2 + J q (^p 4 + ^q - ^ q'j dt 

is a conserved quantity for the nonconservative system. This conclusion is 
nontrivial, and difficult to verify directly from the definition of nonconser¬ 
vative constant of motion (Definitional). 

The examples show how the previous nonconservative results found in 
the literature are easily covered by Theorem 1221 Theorem EH is, however, 
more general, since it covers an arbitrary complex dynamical control system 
of the form q(t) = ip(t,q(t),u(t)). Moreover, Theorem El introduces a new 
Hamiltonian perspective to nonconservative Noether’s theory. 


where f = J (£ - qr) (pq + ^q 


2 p 

a 
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